Water-Filling: A Novel Approach of Load Rebalancing for File Systems in Cloud

نویسندگان

  • Divya Diwakar
  • Sushil Chaturvedi
  • S. K. Shrivastava
  • Q. H. Vu
  • B. C. Ooi
  • M. Rinard
چکیده

File systems serves as the backend for cloud computing and load balancing is the relevant issue in context of resource utilization for distributed file systems in cloud. Prior to this, it is fruitful to identify the load on the storage servers (nodes) which is equivalent to number of file chunks it stored. Here is an extension of load balancing i.e. water-filling load rebalancing operated on distributed approach based on water-filling methodology, contrasting all the earlier algorithms that were grounded on centralized and distributed approaches, is used for balancing the load on servers by distributing file chunks making it more amplified to perform map reducing tasks. Water-filling approach enhances the scope of algorithm by calculating the total load exchange cost and rejoining cost in terms of file chunks migrated. Besides this, distributed approach, which employs self reliant load balancing on each node, is preferred due to its effortlessness. In distributed approach the node having highest and the lowest load is preferred to exchange chunks but often not on least possible load exchange cost. In this paper, an improved load distribution task based on physical network locality significance is calculated by water-filling algorithm, is used as metric for minimizing the load exchange cost to improve the

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Secure Load Rebalancing Algorithm for Distributed File Systems in Cloud

Distributed file systems are key technology for cloud computing applications. In such file system, each node having storage as well as computing functionalities. A file is partitioned into a number of chunks allocated in distinct nodes so that data processing can be performed in parallel. Specifically, in this study, we suggest offloading the load rebalancing task to storage nodes by having the...

متن کامل

Rebalancing the Load in Distributed File Systems

Distributed file systems are key building blocks for cloud computing applications supported the Map Reduce programming paradigm. In such file systems, nodes at the same time serve computing and storage functions; a file is partitioned off into variety of chunks allotted in distinct nodes so Map Reduce tasks are often performed in parallel over the nodes. However, in a cloud computing setting, f...

متن کامل

Balancing the Load to Reduce Network Traffic in Private Cloud

Infrastructure-As-A-Service (IAAS) provides an environmental setup under anyone type of cloud. In Distributed file system (DFS), nodes simultaneously serve computing and storage functions; that is parallel Data processing and storage in cloud. Here, file is considered as a data. That file is partitioned into a number of chunks allocated in distinct nodes so that MapReduce tasks can be performed...

متن کامل

Secure and Privacy-Preserving Distributed File Systems on Load Rebalancing in Cloud Computing

Distributed file systems in cloud computing because Google File System GFS and Hadoop Distributed file systems HDFS scheduled central servers in the direction of manage and load balancing in the metadata. Enabling technology for largescale computation for big data Originated by Google. Open source implementation by Yahoo and Facebook. Distributed file systems DFS are keys structure block for cl...

متن کامل

Stabilizing Load across Cloud for Distributed File Access

Distributed file systems in clouds such as GFS(Google File System) and HDFS(Hadoop Distributed file systems) rely on central servers to manage the metadata and the load balancing. DFS are keys building block for cloud computing application based on the reduce programming. In this file system node at the same time provide computing and storage functions, a file dived into a number of parts alloc...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2015